Min- and Max- Relative Entropies and a New Entanglement Monotone 
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Two new relative entropy quantities, called the min- and max-relative entropies, are introduced 
and their properties are investigated. The well-known min- and max- entropies, introduced by 
Renner are obtained from these. We define a new entanglement monotone, which we refer to 
as the max-relative entropy of entanglement, and which is an upper bound to the relative entropy 
of entanglement. We also generalize the min- and max-relative entropies to obtain smooth min- 
and max- relative entropies. These act as parent quantities for the smooth Renyi entropies [lj], 
and allow us to define the analogues of the mutual information, in the Smooth Renyi Entropy 
framework. Further, the spectral divergence rates of the Information Spectrum approach are shown 
to be obtained from the smooth min- and max-relative entropies in the asymptotic limit. 
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I. INTRODUCTION 

One of the fundamental quantities in Quantum Infor- 
mation Theory is the relative entropy between two states. 
Other entropic quantities, such as the von Neumann en- 
tropy of a state, the conditional entropy and the mutual 
information for a bipartite state, are obtainable from the 
relative entropy. Many basic properties of these entropic 
quantities can be derived from those of the relative en- 
tropy. The strong subadditivity of the von Neumann en- 
tropy, which is one of the most powerful results in Quan- 
tum Information Theory, follows easily from the mono- 
tonicity of the relative entropy. Other than acting as a 
parent quantity for other entropic quantities, the relative 
entropy itself has an operational meaning. It serves as a 
measure of distinguishability between different states. 

The notion of relative entropy was introduced in 1951, 
in Mathematical Statistics, by Kullback and Leibler [2j], 
as a means of comparing two different probability distri- 
butions. Its extension to the quantum setting was due to 
Umegaki [3|. The classical relative entropy plays a role 
similar to its quantum counterpart. Classical entropic 
quantities such as the Shannon entropy of a random vari- 
able, the conditional entropy, the mutual information and 
the joint entropy of a pair of random variables are all ob- 
tainable from it. 

More recently, the concept of relative entropy has been 
generalized to sequences of states, in the so-called Infor- 
mation Spectrum Approach 0, [f| [|, 0, H, Q ■ The lat- 
ter is a powerful method which enables us to evaluate 
the optimal rates of various information theory proto- 
cols, without making any assumption on the structure of 
the sources, channels or (in the quantum case) the en- 
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tanglement resources involved. In particular, it allows us 
to eliminate the frequently-used, but often unjustified, 
assumption that sources, channels and entanglement re- 
sources are memory less. The quantities arising from the 
generalizations of the relative entropy in this approach 
are referred to as spectral divergence rates [see Section 
IVIII for their definitions and properties] . Like the rela- 
tive entropy, they yield quantities which can be viewed 
as generalizations of entropy rates for sequences of states 
(or probability distributions, in the classical case). These 
quantities have been proved to be of important opera- 
tional significance in Classical and Quantum Informa- 
tion Theory, as the optimal rates of protocols such as 
data compression, dense coding, entanglement concen- 
tration and dilution, transmission of classical information 
through a quantum channel and in the context of hypoth- 
esis testing [see e.g. @, i, M, ED, El, El El d]- Hence, 
spectral divergence rates can be viewed as the basic tools 
of a unifying mathematical framework for studying infor- 
mation theoretical protocols. 

A simultaneous but independent approach, developed 
to overcome the limitation of the memoryless criterion is 
the so-called Smooth Entropy framework, developed by 
Renner et al. (see e.g. [3, [ll, [13, 0, 0)- This ap- 
proach introduced new entropy measures called smooth 
Renyi entropies or smooth min- and max- entropies. In 
contrast to the spectral entropy rates, the (unconditional 
and conditional) smooth min- and max- entropies are de- 
fined for individual states (or probability distributions) 
rather than sequences of states. They are non-asymptotic 
in nature but depend on an additional parameter e, the 
smoothness parameter. Similar to the spectral entropies, 
the min- and max- entropies have various interesting 
properties e.g. chain rule inequalities and strong subad- 
ditivity. They are also of operational significance and 
have proved useful in the context of randomness extrac- 
tion and cryptography. 

Recently it was shown (2(| that the two approaches 
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discussed above, are related in the sense that the spectral 
entropy rates are obtained as asymptotic limits of the 
corresponding smooth min- and max- entropies. 

In this paper we introduce two new relative entropy 
quantities, namely the min- and max- relative entropies 
(and their smoothed versions), which act as parent quan- 
tities for the unconditional and conditional min- and 
max- entropies of Renner [l| . These new relative entropy 
quantities are seen to satisfy several interesting proper- 
ties. Their relations to the quantum relative entropy [2l[ 
and to the quantum Chernoff bound |22j are discussed. 
They also allow us to define analogues of the mutual in- 
formation in the Smooth Renyi Entropy Framework. The 
operational significance of the latter will be elaborated 
in a forthcoming paper. We define a new entanglement 
monotone, which we refer to as the max-relative entropy 
of entanglement, and which is an upper bound to the 
relative entropy of entanglement. Moreover, the smooth 
min- and max- relative entropies and the analogous quan- 
tities in the Quantum Information Spectrum framework, 
namely the spectral divergence rates, are proved to be 
related in the asymptotic limit. The proofs are entirely 
self-contained, relying only on the definitions of the en- 
tropic quantities involved, and the lemmas stated in Sec- 
tion no 

The min- and max- relative entropies both have inter- 
esting operational significances. The operational mean- 
ing of the min- relative entropy is given in state discrim- 
ination as the negative logarithm of the optimal error 
probability of the second kind, when the error probability 
of the first kind is required to be zero. This is explained 
in the proof of Lemma [T2l The max- relative entropy, on 
the other hand is related to the optimal Bayesian error 
probability, in determining which one of a finite number 
(say M) of known states a given quantum system is pre- 
pared in. Suppose the quantum system is prepared in the 
k th state, pk, with apriori probability pk, and the optimi- 
sation is over all possible choices of POVMs which could 
be made on the system to determine its state. Then the 
optimal Bayesian probability of error is given by 

P av = l- inf max p k 2 Dma * (pfcll<T) , 

a l<k<M 

where the infimum is taken over all possible quantum 
states, a, in the Hubert space of the system. This oper- 
ational interpretation, was first provided in [23| though 
in a somewhat different formalism. It is also explained 

in m. 

We start with some mathematical preliminaries in Sec- 
tion [Til We define (non-smooth) min- and max- relative 
entropies in Section ITTTl and state how the unconditional 
and conditional min- and max- entropies are obtained 
from them. We also define the min- and max- mutual 
informations. In Section HVl we investigate the properties 
of the new relative entropy quantities. A new entangle- 
ment monotone is introduced in Theorem 1 of Section [Vl 
and some of its properties are discussed. Next, we de- 
fine the smoothed versions of the min- and max- relative 



entropies in Section IVIl After briefly recalling the def- 
initions and basic properties of the spectral divergence 
rates in Section IVlH we go on to prove the relations be- 
tween them and the smooth min- and max- relative en- 
tropies in Section IVIIIl These are stated as Theorem 2 
and Theorem 3, which along with the new entanglement 
monotone (Theorem 1), and the properties of the min- 
and max- relative entropies, constitute the main results 
of this paper. Our results apply to the quantum setting 
and thus include the classical setting as a special case. 



II. MATHEMATICAL PRELIMINARIES 

Let 23(H) denote the algebra of linear operators act- 
ing on a finite-dimensional Hilbcrt space TL. The von 
Neumann entropy of a state p, i.e., a positive operator 
of unit trace in B(H), is given by S(p) = — Trplogp. 
Throughout this paper, we take the logarithm to base 2 
and all Hilbert spaces considered are finite-dimensional. 
We denote the identity operator in B(TL) by /. 

In this paper we make extensive use of spectral pro- 
jections. Any self-adjoint operator A acting on a finite- 
dimensional Hilbert space may be written in its spec- 
tral decomposition A = X^i-Rj where Pi denotes the 
orthogonal projector onto the eigenspace of A spanned 
by eigenvectors corresponding to the eigenvalue A^. We 
define the positive spectral projection on A as {A > 
0} := 5Za >q-^' the projector onto the eigenspace of 
A corresponding to positive eigenvalues. Correspond- 
ing definitions apply for the other spectral projections 
{A < 0}, {A > 0} and {A < 0}. For two operators A and 
B, we can then define {A > B} as {A - B > 0}. The 
following key lemmas are useful. For a proof of Lemma 
Q] and Lemma O see @, 0, Hi ■ Lemma 2 is proved in [2(| • 

Lemma 1 For self-adjoint operators A, B and any pos- 
itive operator < P < I, we have 

Tt[P(A-B)] < Tt[{A> B}(A- B)] (1) 
Tr[P(A-B)] > Tr[{A< B}(A- B)). (2) 

Identical conditions hold for strict inequalities in the 
spectral projections {A < B} and {A > B}. 

Lemma 2 Given a state p n and a self-adjoint operator 
w„, for any real 7, we have 

Tr[{p„>2"^„K l ] <2-"T. 

Lemma 3 For self-adjoint operators A and B, and any 
completely positive trace-preserving ( CPTP) map T , the 
inequality 

Tt[{T(A) >T(B)}T(A- B)} <Ty[{A> B}(A- B)] 

(3) 

holds. 
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The trace distance between two operators A and B is 
given by 

\\A-B\\ X := Tr[{A > B}(A-B)] — Tr[{A < B}(A-B)] 

(4) 

The fidelity of states p and p' is defined to be 
F(p,p') := Tn\J php'pk. 

The trace distance between two states p and p' is related 
to the fidelity F(p,p') as follows (see (9.110) of (H): 



2 Hp - p'II i < a/i - *Xp, p') 2 < v/2(i - F(p, p')) • (5) 

We use the following simple corollary of Lemma [TJ 

Corollary 1 for self-adjoint operators A, B and any 
positive operator < P < I , the inequality 

\\A-B\\i<e, 

for any e > 0, implies that 

Tt[P(A- B)] < e. 

We also use the "gentle measurement" lemma (2|| [2?J : 

Lemma 4 For a state p and operator < A < I, if 
Tr(pA) >1-S, then 

\\ P - VXpVXWi < 2Vs. 

The same holds if p is only a subnormalized density op- 
erator. 

III. DEFINITIONS OF MIN- AND MAX- 
RELATIVE ENTROPIES 

Definition 1 The max- relative entropy of two opera- 
tors p and a, such that p > 0, Trp < 1 and a > 0, is 
defined by 

D max (p\\a) := logmin{A : p < Xa} (6) 

Note that D max (p\\a) is well-defined if suppp C supper. 
For p and a satisfying suppp C supper, D m&x (p\\a) is 
equivalently given by 

D max {p\\a) :=log/i max (cr~3p ( r _ 5) ) (7) 

where the notation p max (A) is used to denote the maxi- 
mum eigenvalue of the operator A, and the inverses are 
generalized inverses defined as follows: A" 1 is a general- 
ized inverse of A if AA~ X = A" 1 A = Pa — P4-1, where 
Pa, Pa- 1 denote the projectors onto the supports of A 
and A -1 respectively. 

Another equivalent definition of D max (p\ \a) is: 

AnaxOlk) := logmin{A : Tr [P* (p - Act)] - 0}, (8) 

where P£ := {p > Xa}. 



Definition 2 The min- relative entropy of two operators 
p and a, such that p > 0, Tip < 1 and a > 0, is defined 
by 

D min (p\\a) := -logTr(7r p0 -) , (9) 

where ir p denotes the projector onto supp p, £/ie support 
of p. It is well-defined i/ suppp /ias non-zero intersection 
with supp cr. 

Note that 

Anin(p|k) = lim S q (p||ct), (10) 

where S Q (p||(T) denotes the quantum relative Renyi en- 
tropy of order a, with < a < 1, defined by (see e.g. 

S a (p||a):=— ^logTrpV 1 "". (11) 
a — 1 

Various properties of D m i n (p\\a) and D max (p\\a) are dis- 
cussed in Section Hvl 

The min- and max- (unconditional and conditional) 
entropies, introduced by Renner in [l[ can be obtained 
from D m i n (p\\a) and D max (p\\a) by making suitable sub- 
stitutions for the positive operator a. In particular, for 
o~ = I, we obtain the min- and max- entropies of a state 
p, which are simply the Renyi entropies of order infinity 
and zero, respectively: 

ffmin(p) = -Anax(Pl|-0 = -log||p||oo (12) 

H max (p) = -Amn(p||I) = logrank(p). (13) 

The min- and max-entropies of a bipartite state, pab, 
relative to a state a B , are similarly obtained by setting 

0~ = I A ® 0~B'- 

H min {p A B\o-B) ■= -logmin{A : p A B < X ■ I A <S> Pb} 

= -D max (pAB\\lA<&C- B ) (14) 

and 

H max (pAB\<TB) ■= log Tr (ttab [I a ® vb)) , 

= -D rBin {pAB\\lA <8> ctb) (15) 

In the above, ttab denotes the projector onto the support 
of pab- 

In addition, by considering a = pa® Pb, we obtain the 
following analogues of the quantum mutual information 
of a bipartite state p = pab- 

Definition 3 For a bipartite state Pab, the min- and 
max- mutual informations are defined by 

D mhl (A:B) := D min (p AB \\p A <8> Pb) 
D max (A : B) := D max (p AB \\p A ® Pb) 

(16) 
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Smooth versions of the min- and max- relative en- 
tropies are defined in Section fVll These in turn yield the 
(unconditional and conditional) smooth min- and max- 
entropies [l|, |20| and mutual informations, upon similar 
substitutions for the operator ct. It was proved in (20| 
that the smooth min- and max- entropies are related to 
the spectral entropy rates used in the Quantum Informa- 
tion Spectrum approach [see Section fVIII or [4j], in the 
sense that the spectral entropy rates are the asymptotic 
limits of the smooth entropies. As discussed in Section 
IVII1 the spectral entropy rates are obtainable from two 
quantities, namely the inf- and sup- spectral divergence 
rates. In Section lVIIIl we prove that these spectral diver- 
gence rates are indeed asymptotic limits of the smooth 
min- and max- relative entropies. 



IV. PROPERTIES OF MIN- AND MAX- 
RELATIVE ENTROPIES 

The min- and max- relative entropies satisfy the fol- 
lowing properties: 

Lemma 5 For a state p and a positive operator a 

Anin(p||<7) <Anax(p||<7) (17) 

Proof (This is exactly analogous to the proof of Lemma 
3.1.5 in [l|). Let tt p denote the projector onto the support 
of p, and let A > such that D meix (p\\a) — log A, i.e., 
Act — p > 0. Then, using the fact that for positive semi- 
definite operators A and B, Tr(AB) > 0, we get 

< Tr((A<r - p)tt p ) = ATr(7r p CT) - 1. 

Hence, 

-Dmin(Hlo') := -logTr(7T p CT) < log A = D max (p\\a) 



Lemma 6 The min- and max- relative entropies are 
non-negative when both p and a are states. They are both 
equal to zero when p and a are identical states. Moreover, 
£'min(p||f J ) = when p and a have identical supports. 

Proof Due to Lemma it suffices to prove that 
-Dmin(p||c) > 0, when p and ct are states. Note that 
Tr(7TpCT ) < Trcr = 1, where 7r p denotes the projector onto 
the support of p. Hence, 

D min (p\\a) :=-logTr(7r p CT) > 0. 

The rest of the lemma follows directly from the defini- 
tions © and ® of the max- and min- relative entropies, 
respectively. 



Lemma 7 The min- and max- relative entropies are 
monotonic under CPTP maps, i.e., for a state p, a pos- 
itive operator a, and a CPTP map T : 

D min {T{p)\\T{a)) <D mia (p\\a) (18) 

and 

D m&x {T{p)\\T{a)) <IW(p|k) (19) 

Proof The monotonicity (|18p follows directly from the 
monotonicity of the quantum relative Renyi entropy. For 
< a < 1, we have [H]: 

S a (p\\a) < S a (T(p)\\T(a)). 

Taking the limit a — ► + on both sides of this inequality 
and using ([10]), yields (fl~8)) . 

The proof of (fl"9|) is analogous to Lemma 3.1.12 of [l[. 
Let A > such that log A = D max (p\\a) and hence (Act — 
p) > 0. Since T is a CPTP map, T(Act - p) = AT(ct) - 
T(p) > 0. Hence, 

D max {T(p)\\T(<T)) := logmin{A' : T(p) < A'T(ct)} 

< logA = Z> maJC (p||(7). (20) 



Lemma 8 The min-relative entropy is jointly convex in 
its arguments. 

Proof The proof follows from the monotonicity of the 
min-relative entropy under CPTP maps (Lemma[7|). Fol- 
lowing [28] , let pi , . . . p n be states acting on a Hilbert 
space Tt, let a±, . . . a n be positive operators in B(H) such 
that supp pi C supper;, for i — 1, . . . ,n, and let {pi}™ =1 
denote a probability distribution. Let p, a e B(H). 
Consider the following operators in B(7i® C n ) 

n n 

A := ^p.Ai = ^2pi\i}{i\® pi, 

i=l i=l 
n n 

B := ^piB,, = y^pi\i)(i\ ct, 

i=l i=l 

Note that the the operators A i7 Bj, i,j e {1,2, ...n}, 
have orthogonal support for i ^ j, i.e., 

Tr Ai A j = = TrAjBj = TrBiBj for i ^ j. (21) 

Let tta and 7r^ denote the orthogonal projectors onto the 
support of A and pi, respectively, with i = 1,2, ...n. 
Then using (f2"Tj) and the convexity of the function — logx, 
we obtain 

n 

D min (A\\B) = -logTr(7r A B) =-log(^p i Tr( 7 r i CT i )) 

i=l 

n 

< Y,Pi [~ lo S ^<^)] 
i=l 
n 

= J2piD min {pi\\o-i). (22) 
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Taking the partial traces of A and B over C n yields the 
operators 

Ttc» A = 2J PiPi ; Tr C " P = piCTi . 

However, since the partial trace over C n is a CPTP map, 
we have by Lemma [7] that 

n n 

Dminfj^PiPiWj^P^) < D ™in(A\\B) (23) 
i=l i=l 

The inequalities ([22)1 and (|23|) yield the joint convexities: 

n n n 

Dmin ( ^ ftPi 1 1 ^ Pm j < y^ft-Dmin(Pilki) (24) 

Z — 1 2 — 1 Z— 1 



Lemma 9 XTie max- relative entropy of two mixtures of 
states, p := X]™=i£W cm< ^ 17 := Xw=iP*°-ij satisfies the 
following bound: 

AnaxGollc) < max D ma , x (pi\\ai) (25) 

l<i<n 

Proof By definition ©: 

A„ ax (p|k) = logmin{A : Tr[P^(p - Act)] = 0}, 

where Pi = {p > Act}. Consider the projection operators 
P^' 1 := {pi > Act^} for i = 1, 2, . . . , n. Then 

0<Tr[P^(p-A<7)] = J^Pi^iP+iPi-^i)] 

i 

(26) 

by Lemma [TJ Set A = maxi<i<„ Ai where for each i = 
1, 2, . . . , n, Xi is defined by 

log A; = D niax (p t \\ai). 

For this choice of A, each term in the sum on the right 
hand side of (|26p vanishes, implying that Tr [P^(p — 
Aa)] = 0, and hence A > D max (p\\a). ■ 

Lemma 10 The min- and max- relative entropies of two 
states p and a are related to the quantum relative entropy 
S(p\\a) := Tr[plogp — ploger] as follows: 

D min (p\ |ff) < S(p\ |ct) < £ max (p| (27) 

Proof We first prove the upper bound S(p\ |ff) < 
-D max (p||cr): 

Let p < 2 q ct, with a = D maK (p\\a). Then using the op- 
erator monotonicity of the logarithm (29| , we have log p < 



a + log a. This in turn implies that p log a > p log p — ap. 
Hence, for a state p, Trploger > Trplogp — a, and 

S(p\\a) := Trplogp-TrplogCT 

< Trp log p — Tip log p + a 

= D max (p\\a). (28) 

We next prove the bound D m i n (p\\a) < S(p\\cr): 
Consider the CPTP map, T, defined by 

T(oj) = ITpUTTp + 7fW7f, 

where u> is any density matrix, ir p is the projector onto 
the support of p, and JT^ = I — ir p . Note that T(p) = p. 

Due to the monotonicity of S(p\ |ct) under CPTP maps, 
we have 

S(p\\a) > S{T{p)\\T{a)) 

= Trp log p - Tip log (7T p a-Kp ) 

= S(p\\n p an p ). (29) 

Define the normalized state a :— —tt p o~tt p where c = 

c 

Tr(7rpCr). Then 

S(p\\wpO-Tr p ) = S(p\\ca) 

= Trp(logp — log?) — (log c). Trp 

= S(p||ff)-logc 

> -logc = P min (p||CT). (30) 

From ([29]) and ([30]) we conclude that D m i n (p\\a) < 
S(p\\a). m 

The following lemma is obtained easily from the defi- 
nitions of the min- and max-relative entropies. 

Lemma 11 The min- and max- relative entropies are in- 
variant under joint unitary transformations. 

Lemma 12 The min- relative entropy of two states p 
and a for which suppp C supper, satisfies the following 
bounds: 

Amn(p||ff) < Anax(p||ff) < -l0gp min (cr), (31) 

where Pmin(o') denotes the minimum non-zero eigenvalue 
of a. Further, 

D min (p\\a)<-log[l-^\\p-a\\i] (32) 

Proof The first inequality in (|31|) has been proved in 
Lemma [SJ Since suppp C supper, we have n p < Tr a , 
where n p and n a , denote the projectors onto the supports 
of p and cr respectively. Further, using the bounds p < 
7T p and 7r CT < /i m in(cr) ^ct, where p m in(cr) denotes the 
minimum non-zero eigenvalue of cr, we obtain 

P < Pmin(cr)~V. 
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Using the definition of £> max (p| |cr) we therefore infer that 

Anax(plk) < -log^min(CT). 

The bound (l32ll follows from the fact that 



(33) 



Tr(7r p CT) > 1- -||p 



which can be seen as follows. Consider the scenario 
of state discrimination. Suppose it is known that that 
a finite quantum system is in one of two states p and 
cr, with equal apriori probability. To determine which 
state it is in, one does a binary Postive Operator- Valued 
Measurement (POVM) with elements E\ and E 2 , and 
Ex + E 2 = I. If the outcome corresponding to E\ occurs 
then the system is inferred to be in the state p, whereas if 
the outcome corresponding to E 2 occurs, then the system 
is inferred to be in the state a. The average probability 
of error in state discrimination is given by 

: 1 - -(TrExp + TiE 2 (r) 



Pe 



= \{TYE 2 p + r TrE l <j) 



(34) 



Note that the two terms in the parenthesis, in the last 
line of (|34p are, respectively, the Type I error and the 
Type II error, in the language of hypothesis testing. By 
Helstrom's Theorem [30| the minimum possible value of 
p™ is given by 

^l-^llp-^lli]- 

Now consider a POVM in which E\ = tt p (the projector 
onto the support of p) and E 2 = I — vr p . In this case, 
the Type I error vanishes and pf — iTr(7r p cr), which by 
Helstrom's theorem satisfies the bound: 



1 Tr(7r p a) > i[l-i||p-a| 



2 v""-' - 2 
hence yielding the desired 



Note that 



2 

bound 

£ ) min(p||f J ) is therefore related to the average probabil- 
ity of error of state discrimination (between the states p 
and cr) when the Type I error vanishes. 

Note that (|33p can also be proved algebraically by a 
simple use of Lemma [T] M 

It is known that if one has asymptotically many copies 
of two states p and cr, the error in discriminating between 
them decreases exponentially, and the error exponent is 
given by the so-called quantum Chernoff bound £ (p, cr) 
|22l ] . The latter has been shown to be given by £ (p, cr) — 
— \og(mm < s <iTi-p s o- 1 ~ s ). From the expression (flU|) it 
follows that the min-relative entropy provides a lower 
bound to the quantum Chernoff bound, i.e., 

£(p,(j) > Anin(plk). 



V. A NEW ENTANGLEMENT MONOTONE 

Here we introduce a new entanglement monotone for 
a bipartite state p. We denote it by E max (p) and call it 
the max-relative entropy of entanglement. 



In [3l| , Vedral and Plenio proved a set of sufficient con- 
ditions under which a measure D{p\\a) of the "distance" 
between two bipartite quantum states, p and a, defines 
an entanglement monotone, E(p), through the following 
expression: 

E(p) := mm D(p\\a). 

Here the minimum is taken over the set T> of all separa- 
ble states (see also [32]). The conditions ensure that (i) 
E(p) = if and only if p is separable; (ii) E(p) is un- 
changed by a local change of basis and (Hi) E(p) does not 
increase on average under local operations and classical 
communication (LOCC) 34]. By proving that these con- 
ditions are satisfied by -D max (p| |cr), we are able to define 
a new entanglement monotone. 



Theorem 1 For a bipartite state p, the quantity 



E m&x (p) := minL> max (p||cr), 



(35) 



where the minimum is taken over the set T> of all sepa- 
rable states, is an entanglement monotone. 

Proof It suffices to prove that the max-relative entropy 
-Dmax(p| |c) satisfies the following properties, which con- 
stitute the set of sufficient conditions proved in [3l| . 

• L) max (p||cr) > with equality if and only if p = cr. 

• L ) ma X (p||cr) = D max (UpU f | \UaW) for any unitary 
operator U. 

• Ana X (Tr p p||Tr p cr) < L> max (p| |cr), where Tr p de- 
notes a partial trace. 

• Y^i a i D mnx(Pi/ai\\Vi/Pi) < Si Anax (pi 1 1 Cj), 

where on = Trpi, fa = Tra^, pi = VipV} , 
a i = V i aVl and £^^ = 1. 

• For any set {Pi} of mutually orthogonal projectors, 
i.e., P^Pj — 6{jPi : 



D max (^PipPi\\Y,PiePi, 



D^fPipPiWPiC-Pi 



(36) 



• For any projector P, 

D max (p®P\\a®P) = A„ax(p||0-). 

From Lemma|n]we have that if p = a then -D max (p| |cr) = 
0. To prove the converse, i.e., -D m ax(p||cr) = implies 
that p = cr, note that -D max (p||cr) = (cr — p) > 0. 

On the other hand, since p and cr are states, we have 
Tr(cr — p) = 0, which in turn implies that (cr — p) = 0. 
This completes the proof of the first property. The second 
property follows from Lemma 111! The third property 
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follows from Lemma [3 since the partial trace is a CPTP 
map. 

The fourth property can be proved as follows. Using 
the definition ([7]) of the max-relative entropy, we have 

^ at Anax (pi I Ctj 1 1 Oj /Pi ) 
i 

i 

= ^a,-log(— fhnaxfa'i 2 p l a i 5 )) 

i 1 

= ^ otj log — + ati log ^ max (a i 2 p i a l 2 ) 



< - X! a ' 1 log IT. + log ^ max ( CT 

i i 

< ^2logp max (ai 2 pio-'t 5 ) 

i 

= 2jAnax(PilK). 



(37) 



In the above we have made use of the fact that 
{ai} and {&} are probability distributions, and hence 

y^ on log -j^- > [HI . The fifth and sixth properties are 
seen to hold by inspection. ■ 

Lemma 13 The max-relative entropy of entanglement, 
E mM , is an upper bound to the relative entropy of entan- 
glement fM] 

E(p) :=mmS(p\\a). 
Proof Let a* be a separable state such that 

£max(p) (38) 



AnaxCHIO = minD(p||<r) 



By Lemma [TU1 we have 

D max (p\\a*) > S(p\\a*) 

> mm S(p\\a) 

= E(P). 



(39) 



Properties of E max (p) will be investigated in a forth- 
coming paper. 



VI. SMOOTH MIN- AND MAX- RELATIVE 
ENTROPIES 

Smooth min- and max- relative entropies are gener- 
alizations of the above-mentioned relative entropy mea- 
sures, involving an additional smoothness parameter e > 
0. For e = 0, they reduce to the non-smooth quantities 



Definition 4 For any e > 0, the e-smooth min- and 
max-relative entropies of a bipartite state p relative to a 
state a are defined by 

D mx*(p\W) : = SU P Anin(plk) 



and 



£>max(plH := inf Dm*x(ft\\o) 
peB'( P ) 

where B e (p) := {p > : ||p-p||i < e,Tr(p) < Tr(p)}. 

The following two lemmas are used in the proof of The- 
orem [5] given below. 

Lemma 14 Let pab and gab be density operators, let 
Aab be a positive operator, and let A € K such that 

Pab < 2 A • (tab + ^ab ■ 



Then D 6 max (p AB \\a ab) < A for any e > v /8Tr(A j4B ). 

Lemma 15 Let pab o,nd gab be density operators. 
Then 

DL^ApabWcab) < A 
for any A € K. and 



e = yj8Tr[{p AB > 2*a AB } PAB ] ■ 

The proofs of these lemmas are analogous to the proofs 
of Lemmas 5 and 6 of (20| and are given in the Appendix 
for completeness. 



VII. SPECTRAL DIVERGENCE RATES 

In the quantum information spectrum approach one 
defines spectral divergence rates, defined below, which 
can also be viewed as generalizations of the quantum rel- 
ative entropy. 

Definition 5 Given a sequence of states p = {p n }%Li 
and a sequence of positive operators a = {cr n }:^=i, the 
quantum spectral sup- (inf-) divergence rates are defined in 
terms of the difference operators n„( 7 ) = p n — 2 ni o~ n as 

D(p\\a) := inf | 7 : limsupTr[{II n ( 7 ) > 0}II n ( 7 )] = o} 

(40) 

D(p\\a) := sup { 7 : lim inf Tr [{IT n ( 7 ) > 0}II n ( 7 )] = l} 

(41) 

respectively. 
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Although the use of sequences of states allows for im- 
mense freedom in choosing them, there remain a number 
of basic properties of the quantum spectral divergence 
rates that hold for all sequences. These are stated and 
proved in In the i.i.d. case the sequence is generated 
from product states p = {g® n }%L 1 , which is used to re- 
late the spectral entropy rates for the sequence p to the 
entropy of a single state g. 

Note that the above definitions of the spectral diver- 
gence rates differ slightly from those originally given in 
(38) and (39) of [13j . However, they are equivalent, as 
stated in the following two propositions [35(. For their 
proofs see [1] or (20j . 

Proposition 1 The spectral sup-divergence rate D(p\\a) 
is equal to 

V(p\\a) := inf [a : limsupTr[{p„ > 2 na a n }p n ] = o} 

(42) 

which is the original definition of the spectral sup- 
divergence rate. Hence the two definitions are equivalent. 

Proposition 2 The spectral inf- divergence rate D(p\\a) 
is equivalent to 

V(p\\a) = sup (a : lim inf Tr \{p n > 2 na a n }p n ] = l) 

(43) 

which is the original definition of the spectral inf- 
divergence rate. Hence the two definitions are equivalent. 

Despite these equivalences, it is useful to use the def- 
initions (|40p and (|4ip for the divergence rates as they 
allow the application of Lemmas [TJ [2] and [3] in deriving 
various properties of these rates. 

The spectral generalizations of the von Neumann en- 
tropy, the conditional entropy and the mutual informa- 
tion can all be expressed as spectral divergence rates with 
appropriate substitutions for the sequence of operators 

O = {<Tn}n=l- 

A. Definition of spectral entropy rates 

Consider a sequence of Hilbert spaces {H n }%Li, with 
Tin = TL® n . For any sequence of states p = {p n }n°=ii 
with p n being a density matrix acting in the Hilbert space 
Ti n , the sup- and inf- spectral entropy rates are defined 
as follows: 

S(p) = inf f 7 : liminf Tr[{p n > 2-^I n }p n ] = l} (44) 

S(p) = sup{ 7 : limsu P Tr[{p„ > 2~^I n }pn] = o}. 

(45) 

Here /„ denotes the identity operator acting in TL n - 
These are obtainable from the spectral divergence rates 
as follows [see Q: 

S(P) = -R(p\\I) ; m = -D{p\\I), (46) 



where / = {/ n }^i is a sequence of identity operators. 

It is known that the spectral entropy rates of p are 
related to the von Neumann entropies of the states p n as 
follows: 

Sip) < liminf -S(p n ) < limsup -S(p n ) < S(p). (47) 

n^oo n n-*oo Tl 

Moreover, for a sequence of product states p = 

{p® n }n%V 

S(p) = lim -S(p n ) = S(p). (48) 

n — >oo Ji 

For sequences of bipartite states p — {Pn B }n%n with. 
Pn B 6 B {{TLa ® TLb)® 71 ), the conditional spectral en- 
tropy rates are defined as follows: 

S(A\B) := -D{p AB \\I A ®p B ); (49) 
S{A\B) := -D(p AB \\I A ®p B ). (50) 

In the above, T A = {I A }^ =1 and p A = {p A }^ =11 with 
I A being the identity operator acting in Tt® n and p A — 
TibP AB , the partial trace being taken on the Hilbert 
space 7i% n . 

Similarly, the mutual information rates are given by 

S(A;B) := D(p AB \\p A ®p B ); (51) 
S{A\B) := D{P AB \\P A ®P B )- (52) 

These spectral entropy rates have several interesting 
properties (see e.g.[||]) and also have the operational sig- 
nificance of being related to the optimal rates of protocols 
(see the discussion in the Introduction and the references 
quoted there). 

VIII. RELATION BETWEEN SPECTRAL 
DIVERGENCE RATES AND SMOOTH MIN- 
AND MAX- RELATIVE ENTROPIES 

In this section we prove the relations between the spec- 
tral divergence rates and the smooth relative entropies. 
As mentioned in the Introduction, the proofs are entirely 
self-contained, relying only on the definitions of the en- 
tropic quantities involved, and the lemmas stated in Sec- 
tion nu 

A. Relation between D(p\a) and the smooth 
max-relative entropy 

Theorem 2 Given a sequence of bipartite states p — 
{p n }n%i7 an d a sequence of positive operators a = 
{°n}5zLi; where p n ,cr„ S B(TL® n ), the sup-spectral di- 
vergence rate D(p\\a), defined by |^0| ) (or equivalently by 
\4*fy) t satisfies 

~D{p\\d) = lim lim sup -D £ max (p n \ \ a n ), (53) 
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where D^^pnWan) is the smooth max- entropy of the 
state p n of the sequence p, and the operator a n of the 
sequence a. 

Proof 

We first prove the bound 

D{p\\d) > lim limsup -D £ max (p n \\a n ), (54) 

Let S > be arbitrary but fixed, and define 

j:=D(p\\a)+6. (55) 
Then from Proposition Q] it follows that 

limsup Tr[{^ B > 2^a^ B }p^ B ] = . (56) 

n — >oo 

In particular, for any e > there exists no € N such that 
for all n > no, 

Tr[{ P r >2"V B K S ] < Tr[{^>2"V B W B ] 

e 2 

< T ■ (57) 
Using Lemma fT51 we then infer that for all n > no 

DL ax (Pn B \Wn B )<n! (58) 

and, hence 

limsupi^ ax (^ s |kD<7- (59) 

n — >oo *t 

Since this holds for any e > 0, we conclude 
lhx l limsup -D^{pi B \\^ B ) < j = D(j>\\Z)+6 . (60) 

£ ™ n — >oo n 



The assertion (1541) then follows because this holds for any 
arbitrary 5 > 0. 

We next prove the bound 

D{p\\o~) < limlimsup-D^ ax (p„||CT„), (61) 

e >v n — >oo n 

Let ~p n ,e be the operator for which 

Anax (Pn,e 1 1 0"n) = inf -Dmax(/5| |/0«) = -©max (z 3 " 1 1 °~n ) ■ 

This implies, in particular, that for any A for which 
log A > ^maxCPnlkn), w e have 

Tr[{p„ i£ > \o- n }(fin,e - Acr n )] = 0. (63) 

For any real constant 7 > 0, let us define the projection 
operator 



Note that 

Tr[P>„] = Tr[PZp n , E ] + Ti[P^(p n - p n , £ )] 

< Tr[P2(p n>e -2 na a n )] + 2" Q Tr[P r > n ] 

+Tr[{/3„ > p n ,e}{Pn ~ Pn,s)] 

< Tr[{p n ,e > 2 na a n }(p n , s - 2 na a n )] 

+ 2 «(a- 7 ) +£ (g 5 ) 

In the above we have made use of Lemma [TJ Lemma [2] 
and Corollary [TJ 

Let A :— 2 na and choose log A = D^ ax (p„| |cr„)+(5/2 for 
any arbitrary S > 0. Further let us choose 7 = a + 5/2. 
Then, by ([63|) . the first term on the right hand side of 
(f6"5)) vanishes. Moreover, the second term also goes to 
zero as n — * 00. Therefore, for n large enough and any 
5 > 0, in the limit e — > 0, we must have that 



Tr(PZpn) < S 



(66) 



This together with Proposition [T] implies that 7 > 
.D(j5j|<x). The required bound (JHTJ) then follows from the 
choice of the parameters a and 7. M 



B. Relation between D(j)\S) and the smooth 
min-relative entropy 

Theorem 3 Given a sequence of bipartite states p — 
{Pn}^Li, o,nd a sequence of positive operators o — 
{°~n}%Li, where S B(H® n ), the inf-spectral di- 

vergence rate D_(p\\a) , defined by |^J[ ) (or equivalently by 
h4-3ty), satisfies 

D(p\\°) = limhminf -D s min (p n \\a n ), (67) 

e^0 n— >oo ji 

where Z)^ lin (p I1 ||(T rl ) is the smooth min-relative entropy of 
the state p n of the sequence p and the operator a n of the 
sequence a. 

Proof From the definition (|43| of D.(p\\^) ^ follows that 
for any 7 < D_{p\\&) and any 6 > 0, for n large enough 



Tr[P>„] > 1-6, 



(68) 



where := {p n > 2"V„}. 

For any given a > 0, choose 7 = D.(p\\&) ~~ a ; an d ^ 



(69) 



Then using (jB"5)) and the "Gentle measurement lemma" , 
Lemma HI we infer that, for n large enough, p„ j7 € 
B e (p n ) with e = 2\/5- Let 7r„ i7 denote the projection 
onto the support of p n ,~/- 
We first prove bound 



P 7 ! := {/>„ > 2™V„}. 



(64) 



lim limmf-I^ in (p„|K) > (70) 

e— »0 n— »oo tt, 
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For n large enough, 

D min(Pn\\cr n ) 



= SUp AninOJIcTn) 

p„es«( P „) 

^ ^min (Pn,7 1 1 &n ) 

= -logTr(7T„ i7 cr„) 

> -logTr(P„, T (7 n ) >n 7 . (71) 



The last inequality in (|TTj) follows from LemmaO Hence, 
for n large enough, 



-D e m -MK) > J = D(P\\°) ~ a, 



(72) 



and since a is arbitrary, we obtain the desired bound 

CZ0D- 

To complete the proof of Theorem [3j we assume that 
]xm]imm£-D e min {p n \\a n ) > Dfflfi), (73) 

£— »0 n— >oo n 

and prove that this leads to a contradiction. 
Let p~ n ,€ be the operator for which 



•^LinCpnlkn) = D mhl (p rh£ \\a n ) = - log Tr(7r„ i£ Cr„) , 



where 7r„ i£ is the projection onto the support of p„ 
Note that 



(74) 



Tr(7r„ !£ p„) = Tr[7r„, e ((p n - p n ,e) + Pn,s)] 

= Tr[7r„ i£ (p„ - p n ,e)] + Trp„ i£ 

> Tr[{p„ < p n , £ }(pn ~ Pn.e)] + ^[Pn.e] 

> -£ + l-e= l-2e. (75) 



We arrive at the second last line of (|75|) using Lemma 
[TJ The last inequality is obtained by using the fact that 
Pn,e £ B E (p n ) 7 and the bound 

Tl'[{p„ < Pn,e}(Pn ~ Pn,e)} > S, 

which arises from the fact that p n ^ £ € B s (p n ). 
Define, 



(3 e := liminf 



rl 



lim inf 

n — >oo 



D m in{Pn,e\\^n) 

- logTr(7r„^cr„) 



(76) 



and 



7 := lim f3 e 



Obviously, f3 e > 7. Note that the assumption (|T3")) is 
equivalent to the assumption 7 > D_(p\\a). Let 70 be 
such that 



Then, for any fixed e > there exists no € N such that 
for all n > Hq 



1 



D m in(Pn,e\\ a n) > Pe 



(78) 



The above inequality can be rewritten as 

Tr^O < 2""^ (79) 
Using (f79|) we obtain the following: 

Tr(^„, E p„) = Tr[?„, £ (Pn-2" 7 V„)] + 2"^Tr [^, £ ct„] 

< Tr[{p„ > 2 n ~<°a n }(p n - 2 n ^a n )] + 2 n ^2~ n ^ 

< Tr[{p„ > 2 n ~i°a n }{ Pn - 2 n ~<°a n )] + 2~ n ^~^ 

(80) 

The second term on the right hand side of (|80|) tends 
to zero asymptotically in n, since 8 £ > 0. However, the 
first term does not tend to 1, since 70 > D(p\\a) by 
assumption. Hence we obtain the bound 



Tr(7r„ je p„) < 1 - c , 



(81) 



for some constant Co > 0. This contradicts ([75)1 in the 
limit e — > 0. ■ 



IX. APPENDIX 



Proof of Lemma 1141 

Proof Define 



olab ■= 2 ■ (JAB 
I3 AB ■= 2 A • a AB + A 



AB 



and 



Tab ■= a\ B i3 A l 



Let 1^) = \^)abr be a purification of /5ab and let l^/') := 
Tab ® /fl|*> and p' AB := Tr R {\^')(^'\). 
Note that 

Pab = T A bPabT\ b 
< T A b(3abT ab 

— a AB = 2 A • <T AB , 

which implies D maK (p' AB \\aAB) < A. It thus remains to 
be shown that 



Wpab - PabWi < V8Tr(A AB ) . (82) 
We first show that the Hermitian operator 



Tab ■= 2^ Tab + T ab) 



satisfies 



& >lo>D(p\\a). 



(77) 



Tab < Tab 



(83) 
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For any vector 



)AB, 



\\t ab \4>)\\ 2 = {4>\t\ b t ab \4>) = (^ AB \a AB p A l\4>) 

<(^|/3j^ s/ 3;ll0) = |||0)|| 2 

where the inequality follows from a AB < Pab- Hence, 
for any vector \<j)), 



\T AB \ct>)\\ <\\\T AB \ 
< \\\Tab\ 



IT 



AB I 



< 



which implies (|83[) . 

We now determine the overlap between |\E') and |\&'), 

(*|*') - {9\T AB ®I R \V) 

= Tr(|*)(*|T AS ® I R ) = Tr(p AB T AB ) . 

Because p AB has trace one, we have 

1 - | W)l < 1 - & W) = Tr( PAB (I AB - f AB )) 

< Tr(/3 AB (I AB - f AB )) 

1 1 

= Tr(p AB ) - Tr(a AB PX B ) 

< Tt(/3 ab ) - Tr(a AB ) = Tr(A AB ) . 

Here, the second inequality follows from the fact that, 

because of ([83]) , the operator I AB — T AB is positive, and 

i_ 

Pab < Pab- The last inequality holds because a AB < 
i 

Pab i which is a consequence of the operator monotonicity 
of the square root (Proposition V.1.8 of [29]). 

Using ([5]) and the fact that the fidelity between two 
pure states is given by their overlap, we find 



||*)(*| - | Willi < 2x72(1 -|W)I) 



< 2V2Tr(A AB ) < e . 



Inequality (|82p then follows because the trace distance 
can only decrease when taking the partial trace. M 



Proof of Lemma [ 

Proof Let and A AB be mutually orthogonal posi- 

tive operators such that 

A AB - ^AB = PAB - 2 X a AB . 



Furthermore, let P AB be the projector onto the support 
+ 

AB i 



of At B , i.e., 



Pab = {pab > 2 a ctas} 



We then have 



PabPabPab = Pab{^ ab + 2 v AB - A AB )P AB 
>A1 



AB 



and, hence, 



'8Tr(A+ B ) < yj8Tr(P A BPAB)) = e • 
The assertion now follows from Lemma [14] because 
Pab < 2 x a AB + Aj 



AB 
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